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1. (U) Delay-Tolerant Networking intro

i. Outside world: protocols and software
n. lC Applications of DTNs

2. (TS//S|//REL) Summary of R4 work
i. CHIMNEYPOOL integration
u. Wireless testing

3. (TS//Sl//REL) Interesting details
i. DTN Routing
ii.  security

    

Mobile Ad-Hoc Networks (U)

(U/IFOUO) A wireless network with no
infrastructure
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 lntennittently Connected Network (U) 

   

(U/lFOUO) Many wireless networks will not
 nectivity
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Delay-Tolerant Networks (U)

(U/lFOUO) DTNs use a store-carry-forward
approach to take ad ntage of node
mobility 
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Beginnings of DTN (U)

2000; Epidemic Routing 1990s: Interplanetary Network
Vahdat and Becker NASA. JPL

 7. 2002, 2004: ZebraNet

3. Juang, Oki, Wang, Martonosi, Peh, Rubenstein
Rb 2002: Mobility Increases Capacity in Ad-hoc Wireless Networks

‘b Grossglauser and Tse

2003: A DTN Architecture for Challenged Internets
Kevin Fall

2003: DataMULEs
Shah, Roy, Jain, Brunette

2003: Probabilistic Routing in Intermittently Connected
Networks
Lindgren, Doria, Schelen
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. Nodes exchange "summary vectors"
. Each node sends the data that the other node lacks
- Summary vectors implemented as a Bloom Filter

. Followed by Immunity concept: Resource and performance tradeoffs
in delay-tolerant wireless networks, 2005; Small and Haas

 

 

Wildlife tracking project at Princeton
GPS + other info gathered by collars on zebras

Data migrated back to base using "History-Based"
routing ' -

 

 

   

Beginnings of DTN: IPN (U)

Inter-Planetary Network

Long distances a long propagation delays
Intermittent connections

Known contact schedule a Contact Graph Routing
Worked on since the 19905 by NASA, JPL, incl Vint Cenc

\Q‘ESA Mars Express

   
  

 

NASA PhUEan

W Lander
0

[Figure taken from Vint Cerf‘s 2010
presentation: “When Intuition Fails"]

 

 
     

Beginnings of DTN: DataMULEs (U)

Data MULEs: modeling a three-tier architecture for sparse
sensor networks

2003 Paper by R. C. Shah, S. Roy, S. Jain, W. Brunette

Has mobile MULEs relaying data from sensors to well-
connected Access Points

Similar: A Message Ferrying Approach for Data Delivery in
Sparse Mobile Ad Hoc Networks, 2004; Zhao Ammar,

Zegu ra

d d i -

   

   

What’s a DTN For? (U//FOUO)

Wildlife tracking - VANETS, Public transit
ZebraNet' SWIM, TurtleNet — DieseINet, Braunschweig, NICT
- Battlefields/disaster areas
  DARPA DTN Program
Under water - Sensor nets
Underground (mines) - Heterogeneous networks

[Integrating Multiple and Heterogeneous
Challenged Networks for Large-sized Data
Transfer, 2009 Nagata et al]

[DTN Communication in a Mine, 2010
Ginzboorg, Karkkainen et al]

Rural areas

N4C, DakNet, KioskNet, TIER,
Bytewalla
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Content dissemination
- [PodNet, 2006 — Present; Legendre,  t

  

   

 
 
  

   
  

Lenders. May, Karlsson] -
— Haggle Project

mu Samar
Ecumrnl

Wren!an arm“ I f!

A?"
Social Networking 4% 
gm: sea a’
. . 2v q -
Distributed Sotrage ' —
— [TierStore, 2008; Demmer, Du, _

Brewer]

- [om-based ContentStorage and - Cellular Traffic Offloading

Retr’eva" Ott' P'tkanen] - [Cellular Traffic Offloading through
Opportunistic Communications: A Case
Study, 2010; Han, Hiu et al]

  

 

Standardization Activities* (U)

DTNRG has been part of the IRTF since (at least) 2002
RFC 5050 defines the Bundle Protocol
Application-layer overlay that moves "bundles" of data
Convergence Layers move bundles over different

networks
Application Application . . .

‘ Bundle Pratan l
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Protocol Highlights (U/IFOUO)

Modular architecture

— Convergence layers
— Routers

— Neighbor discovery
Security extensions
Persistent storage

Hop-by-hop and end-to-end reliability
possible

 

 

 

  

 

 

“ Bundle Protocol Architecture (u/lFouo) 

Bundle Bundle Protocol Agent (BPA)
Layer

 

Convergence
Layer

UDP CL File CL Ax_25
CL
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Bundle Protocol Stack Landscape

  
    
      

Vapor A
(TS/lSI/IREL) <| . l>
FUZZYLINT iPhone 9 Q
Lightweight GA Tech T L V

     
     
 
  

Bliﬁow C# stack  SPINDLE
Java stack /,  ,
A . I I I . I I I .
V o
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Implementation
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Real

Summary of Intelligence
Community Applications
(U/lFOUO)

 

 
     

Covert Communications (TS/ISl/IREL)

(TS/ISl/IREL) Provide covert comms in denied areas
where no infrastructure exists, or where using the
infrastructure would compromise the operation.

(S/IREL) Several “brush-pass" wireless hand-offs as
an untraceable alternative to scheduled meetings,
dead drops.

(TS/ISl/IREL) DTN provides an open-source solution
running on commercial handheld devices z.
Unattributable.
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Close Access (TS/lSl/IREL)

- (TS//S|//REL) Implant in a secure
facility or denied area

- (TS//S|//REL) Need to transfer data
and commands over two or more
hops

- (TS//S|//REL) May rely on mobile
nodes and unwitting data mules

 

 

(TS//S|//TK) Moving data between ground stations using CubeSats.
Coverage every ~l.5 hours. Need DTN

(TS/lSI/lTK) They use DTN2, ION, contact graph routing
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- (TS//Sl//REL) Provide data flow in and out of
closed nations during internet shut-down

- (U) Ambitious BIG idea

- (U) Proposed CONOP not far from current
work

- (U) Pr0posed internally and externally

- (U) State Dept-funded project had an article
in NYT
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Tagging Tracking & Locating (U)

- (U) Insert GPS trackers in cars or
electronics, but we may never see
them again

- (TS//Sl//REL) Migrate data back to
collection point via DTN

- (TS//Sl//REL) Original CONOP for
RAPTORGALAXY

 

 

 

CovComm

Close Access

NRO CubeSat
Comms

Summary of IC applications (U/lFOUO)

Crowd-
Sourcing

  

Tagging
Tracking &
Locating

 

Unattributable

COTS handsets

Open-source

 

Data exfiltration
from isolated
networks and
denied areas

TSV field test

 

Comms between
ground stations that
only have occasional
satellite coverage

Use inexpensive
CubeSat platform

 

Provide data flow in
and out of closed
nations

Ambitious BIG idea

Proposed CONOP can
be done now

Proposed internally and
externally

 

Very small hardware

Record locations and
encounters

Use DTN to migrate
data back to collection
points

 

DTN work at R4

 

   

Things We Have Done (U)  

Porting FOS DTN software to mobile devices

 

   

Things We Have Done (U)

Porting FOS DTN software to mobile devices

Developing friendly user interface software so
anyone can use it

 

   

What We Have Been Building (U) 

Porting open source DTN software to mobile devices

Developing friendly user interface software so anyone
can use it

- Testing — determining what actually works

Field testing different configurations and scenarios
Implementing security features

Building new routing modules

- Adding geo-tagging/tracking features

Experimenting with new neighbor discovery methods

 

FUZZYLINT and
CHIMNEYPOOL integration
(TS//Sl//RE L)
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- (TS//S|//REL) Retrieving data from an
implant without visiting the implant
ourselves

- (TS//S|//REL) Need to add DTN lin|<
capability to the implant

- (S//REL) Data mule may be unaware of
their role

- (TS//S|//REL)Rough prototype demoed
at Trident Spectre

 

 

 
     

STRAITBIZZARE (U)

(TS/ISI/IREL) Cross-platform implant built using TAO’s
CHIMNEYPOOL framework

— Ports for Linux, Windows, etc..
— Endpoint-centric : focused on file exfil from a PC
— Remote Procedure Call (RPC) based

(TS/lSll/REL) FRIEZERAMP protocol provides covert
networking

- CHIMNEYPOOL comms module
- Similar to IP, IPsec
- Only supports static network configuration

(TS//S|//REL) FRIEZERAMP links are adapters to
converge FR packets onto the transport layer below

- Examples : https, udp, smtp, etc.

 

 
     

Put SBZ on each device  right?
(TS/IS l// RE L)

(TS//Sl//REL) File exfil CP modules and FRIEZERAMP
treats reliability as only an end-to-end issue

— FR retransmissions are requested by the receiver
and only the sender can retransmit

— Hop-by-hop reliability is desirable

(TSl/S|//REL) Persistent storage module only waits until
link is available then “send and forget"

(U//FOUO) All routes are static and setup a priori

(TS//Sl//REL) Operationally, SBZ on each device is
undesirable in some CONOPs
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- (TS//Sl//REL) —has been building

an ultra-lightweight BPA that can act as a CP
link to a DTN

- (U//FOUO) Locally provides data persistence,
discovery, routing, convergence layers

- (TS//Sl//REL) FR packets are already
fragmented, so this BPA does not need to be as
flexible as others

- (S//REL)Can add covert Convergence Layer
Adapters

 

 

 

    

TAO-Speciﬁc DTN Stack (TS/ISl/IRE L) ‘

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

STRAITBIZARRE WARRIORPRIDE Next-Generation
_ — Stage-2 Implant
\ A
r‘ f
CP DTN Link Modules Comms API
f f \
DTN API

 

 

 

 

Bundle Protocol Agent

 

Discovery Agent

 

(DTN IPND Protocol)

 

 

Covert ??

 

Discovery Agent

 

 

Router

 

‘ (Table Based)

 

 

Storage Agent

 

(File Based)
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Covert CLA ??
(HTI'PIS)

Covert CLA ??
(SMTP)

 

 

 

 

Covert CLA ??
(VOI P)

 

 

 

 
     
     
      

Existing SW
In development

Future work
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Platforms and Capabilities (Ts/ISIIIREL)  

 

 

 

 

 

 

 

 

 

 

 

 

 

Linux Maemo iPhone Gumstix Android Windows and
netbook Java
DTN2 ' v i ' '
IBR—DTN
FUZZYLINT ’ ’
Current Effort
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Wireless testbeds
(U//FOUO)
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Reality Ninja (U//FOU0)

Reality Network Emulators

Application Application

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

Reality Ninja (U//FOU0)

Reality Network Emulators Simulation

a Fruit hr
Application Application Application

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

Reality Ninja (Ul/FOUO)

Reality Network Emulators Simulation

Application Application Application
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CMU Wireless Emulator (U/lFOUO)

 
       
      
  
  

CMU User 5100335
Emulation Emulab Over
Con trollor BUSE’UPS Internet

  
 
   
   
   
 
 
    
 

  
 

Signal

Conversion

Signal
Conversion

 

FPGA-hased
Signal
Propagation
Emulation
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“ Features Propagation model parameters
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Routing and Reliability Issues
Securhylssues

Some Interesting Details

(U)

 

Routing in DTNs (U)

 

 
     

Flood Routing and Epidemic (U)

- 2000: Epidemic Routing [Vahdat and
Becker]

 

 

Static Routing Background (U)

- Bundle Protocol Nodes are identified by Endpoint
Identifiers (Ele) that look like:

dtn://dtnbone.umd.edu.dtn/
dtn://nodea.dtn/
ebr://group5.dtn/

- Convergence Layer connections to neighbors are
called "Links"
— For example a TCP connection to a neighbor is a link

- Each link knows the EID of the neighbor associated
with it

 

 

 

Destination

dtn://sam.dtn/
dtn://bob.dtn/
dtn://amy.dtn/

 

 

Static Routing Tables (U)
One-hop “Direct Delivery"

Next hop
link-O
link-1
link-2

  

_
7-|

 

_

—->-I
_
A-l

Action
FWD
FWD
FWD

 

 

Two-hop “Bundle Ferry"

Destination Next hop
dtn://sam.dtn/ dtn://ferry.dtn/
dtn://bob.dtn/ dtn://ferry.dtn/
dtn://amy.dtn/ dtn://ferry.dtn/
dtn://ferry.dtn/ link-O

Static Routing Tables (U)

Action
FWD
FWD
FWD
FWD

 

 

_
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Static Routing Tables (U)

Two-hop “Bundle Ferry" with wildcards

Destination
dtn://sam.dtn/
dtn://bob.dtn/
dtn://amy.dtn/
dtn://ferry-27.dtn/
dtn://ferry-180.dtn/

 

Next hop
dtn://ferry-*.dtn/
dtn://ferry-*.dtnl
dtn://ferry-*.dtn/
link-O

link-1

Action
FWD
FWD
FWD
FWD
FWD

 

 

 

 

Destination

dtn://twitter.dtn/
dtn://twitter.dtn/
dtn://twitter.dtn/
dtn://twitter.dtn/

 

Static Routing Tables (U)
Multi-hop “Tiered routing"

Next hop
dtn://tier1-*.dtn/
dtn://tier2-*.dtn/
dtn://tier3-*.dtn/
link-O

Action
FWD
FWD
FWD
FWD
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 DTN Routing Bonanza (U) ‘“

 

(Ul/FOUO) People propose routing protocols for many
different environments and purposes.

— Sometimes with novel applications, sometimes with no
realneed

(U) Has inspired the phrase "Yet Another Routing Protocol"

 

—
Neighborhood

Epidemic

Endemic

Epidemic with Immunity

mphone

TI ERStO re

 

 

 

DTLSR (U)

(U//FOUO) Delay-Tolerant Link State Routing

Assumes a mostly stable contact graph
Nodes all flood their recent contacts

Each node maintains an internal picture of the

network, and makes routing decisions based on
Dijkstra's alg

 

 

“Intelligent” Routing: PROPHET (U)

Probabilistic routing in intermittently connected
networks, 2003; A. Lindgren, A. Doria, and O. Scheln

Probabilistic Routing Protocol using History of

Encounters and Transitivity (PROPHET)

 

amy 0.9
bob 0.0
joe 0.0

 

 

 

 

 

 

 

 

sam 0.9
bob 0.0
joe 0.0
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joe

 

0.4

 

 

 

 

 

   

“Intelligent” Routing: PROPHET (U)

Probabilistic routing in intermittently connected
networks, 2003; A. Lindgren, A. Doria, and O. Scheln

Probabilistic Routing Protocol using History of

-l 4

_

   

     

 

sam 0.9
bob 0.0
joe 0.0

 

 

 

 

 

 

 

 

 
   

Network-Coding in DTNs (U)

Imagine trying to distribute a 100MB
bund e in a DTN

Idea:

 

10MB

 

 

 

 

 

 

 

 

 

   

Network-Coding in DTNs (U)

Imagine trying to distribute a 100MB bundle in a DTN
Idea: fragment into 1MB pieces

 

1MB 1MB 1MB

 

 

 

 

 

 

 

 
   

1MB 1MB 1MB
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1MB

 

 

1MB

1MB

any ten pieces and recover the

1MB

 

 

 

 

 

 

Send linear combinations of fragments

A receiver can collect
1MB

data
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Security in DTNs (U)

 

 
     

Security Threats (U)

- (TSl/Sll/REL) Protecting against rogue bundles being
injected into the network

- (TS//Sl//REL) Prevent an adversary from modifying
legitimate bundles

- (S/lREL) Protection against eavesdroppers
- (S/lREL) Authenticate neighbors before establishing links
- (TSl/Sll/REL) Low Probability of Detection / Intercept
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- (U) Provides bundle-layer encryption,
authentication, and data integrity

- (U) Lack of connectivity affects choice
of algorithms and services

- (U) Security polices may be directional

- (U//FOUO) Managing keys and their
accompanying policies is a challenge

 

 

- (U) Hop-by-hop Authentication

- (U) Requires each device to generate a shared secret with
each of its neighbors

- (U//FOUO) Establishing these keys is a challenge
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- (U//FOUO) End-to-end authentication
— RSA digital signatures

- (U) Intermediate nodes can verify the
signature

- (U) Cannot assume connectivity to an
external Certificate Authority

- (U) For signatures, the certificate can
be appended to the message
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- (U//FOUO) Payload data encrypted
with AES in Galois Counter Mode

(GCM)
- (U) Provides data integrity

- (U) AES key is encrypted with the
destination’s RSA public key

 

 
     

Key Management Issues (U)

- (U) How to distribute public keys securely
- (U//FOUO) One option: pass certificates between devices

- (U//FOUO) Another option: pre-placing certificates
— Memory issues

- (U) Revoking keys of compromised devices

 

 

 
   

Link-Layer Security (U)

(U//FOUO) Even with BSP, CL is wide open

(U//FOUO) Develop a mechanism to authenticate
neighbors before allowing them to connect

Enables dropping unwanted bundles
May prevent DoS through too many connections

(Ul/FOUO) Enable different groups of nodes to operate in
the same area but maintain separation

BPA BPA

UDP CL - UDP CL
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(U) Constraints
Lightweight
Low setup latency
Limited bandwidth consumption

Minimal provisioning/maintenance
Compatible with short session
durations
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- (TS//Sl//REL) Have set up external
triggers for establishing DTN links

- (S//REL) Similar work being done
outside to reduce power consumption

- (U) Example: Bluetooth beacons
triggering a wifi connection

- (SI/REL) Another option: use our own
radios for some hops

 

Surveillance-oriented
Demo (U)

 

 

 

 

      
 

 

Parking
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Parking

[ Parking ]

Data sources at “secret” locations on campus. Queue
up or generate data.

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 
 

 

  
 

 

 

Parking

[ Parking ]
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Mobile data generator in a car sending
segments of audio
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Parking

 

 

 

 

 

Parking

 

 

 

 

 

 

 

 

 

 

Destination node in parking lot by the
Comcast Center
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Parking

 

 

 

 

 

 

 

 

 

 

 

 

Parking

 

 

 

 

 

 

 

 

 

Pedestrian relays walk around, and pick up
data from source nodes
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Parking

 

 

 

 

 

 

 

 

 

 

 

Parking

 

 

 

 

 

 

 

 

 

 

/ _
Car Players are typical data ‘©—©"

ferries. They relay data to the
destination.

 

 

 

1. Sources
3. Relays

   

4. Destination

2. Relays

 

 

Questions?

 

